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[57] ABSTRACT 

A system aad method for diagnosis of living tissue diseases 
is described. The system includes a computer device for 
controlling its operation. An operator control device is 
coupled to the computer device. A viewing screen is coupled 
to the computer device for displaying digitized images of the 
living tissue. The operator, using the control device, selects 
desired portions of the digitized image for further image 
enhancement according to a desired image enhancement 
feature selectable from a plurality of image enhancement 
features: The image enhancement features include any com- 
bination of grey scale stretching, contrast enhancement 
based on logarithmic histogram equalization, spot enhance- 
ment and magnification. The system further includes means 
for visualization and quantification of micro-calcifications, 
and means for visualization and quantification of mass 
speculations. 
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SYSTEM AND METHOD- FOR DIAGNOSIS — - * impediments limit the ability of mammography to display- 

OF LIVING TISSUE DISEASES USING the finest or most subtle details in good contrast. In order to 

DIGITAL IMAGE PROCESSING achieve specific diagnoses the radiologist needs to visualize 

FIELD OF THE INVENTION , «*™<™^ of "T^* 

5 Currently, cancers imbedded in dense breast tissue are 

The present invention relates to a diagnostic workstation, found at later stages than those in breasts with high fat 

and more particularly to a computer assisted system and percentage of tissue. These cancers in dense breasts, in 

method for the detection and diagnosis of living tissue particular, need an earlier detection method. Although radi- 

diseases. ologists specializing in mammography have stated that the 

BACKGROUND OF THE INVENTION 10 constramts of conventional mammography can be overcome 

by digital image processing, an effective digital diagnostic 

Breast cancer affects a major segment of the female assistance approach has not yet been available, 
population over the age of 40. To reduce the mortality from 

this disease, it is vital to diagnose it as early as possible. If SUMMARY OF THE INVENTION 

breast cancer is detected early enough, chances of cure are is ^ combination of advanced imaging technology with 

markedly higher Accordingly, breast cancer screening ^ proccssing and analysis irj mc proposed mammo . 

projects designed for early detection of breast cancer have graphic workstation enables radiologists to detect cancer at 

proven to » dramatically reduce the mortality from the disease. its earlies( st ^ to eliminate many unnecessary biop- 

Because breast cancer is such a major public health problem, s - es 

many health authorities worldwide recommend that women 20 r™ 4 . , . j4 ^ j- 1 • . » 1 

undergo routine breast examination. . ™ e des « ned 0 s "PP° rt "d.otopsts analyses 

„, f , , , , - , by characterizing equivocal and suspicious findings detected 

Today, the standard methods for detecting breast cancer on routine mammograms> ^ as t0 visualization of 

are 1) self examination; 2) clinical examination, and 3) ^ suspected findillg and t0 quantify thf > m ammographic 

radiography of the breast, known as mammography. Routine features of suspected lesions . 
mammography screening can reduce mortality from breast 25 . 4 4 

cancer. The American Cancer Society recommends that a . he according to the present invent™ is 

baseline mammogram be taken between the ages of 35 and mtended ,0 ff st ^°S>^ m d.agnosuig breast cancer 

39, every one to two years between the ages of 40-49 and m ™ ^ately ^e hably, and objectively, .t could, also be 

i cn j • j utilized m the detection and analysis of cancer of other body 

annually on women aged 50 years and older. J J 

The main objective of screening mammography is to 30 ™ ..... . . ... 

detect breast cancer early, before it is palpable. The standard h Thed.g.tizaaon processes for mammography appl.cat.ons 

j ■ * .1 * r t have been developed to assist the physician in needle guided 

mammographic procedure is to take two views of each , . , ... f , • - * , 7- 

i t . t , r . „ , , , . 4 biopsies. In addition, on-going research is mainly dedicated 

breast with specially designed mammography equipment. . L t . j • r j - 

rj, , 4 • II ^7* j iL T i?*- to automating the lesion detection process. In contradisunc- 

Inc breast is optimally positioned so that as much tissue as . . . . r . . , 

, r * j mi j • * • . . „ « Qon thereto, the present invention is based in part on the 

possible can be examined. The radiologist visually examines . . , r t . , . „ T . . , 

f. _ - _ v ... T r • view that a computer cannot locate lesions as efficiently and 

the mammographic images on a light box. Using a magni- .... r , . . . . it _ J . 

c . . fu j- i ■ * ■ • ■ i . •? »r rehab ly as the radiologist. Accordingly, the system, by 

fymg glass, the radiologist examines each image in detail. If c • ?■ • . 

4 u j* i • » j * •• ^j- enhancing the visual appearance or a region or interest in the 

the radiologist detects any suspicious findings on mammo- e r *T. i * . • i • »• 

. . . „ mammogram, assists radiologists by improving their diag- 

graphic exammataon, he or she may suggest a biopsy of the j. i* . £ & 

°^ . ■ 0 - - a . , . f i-4n nostic accuracy, and hence, diagnostic effectiveness, 

suspicious area. Suspicious findings include any abnormah- w „ J . c 1 £ , 

ties in the breast tissue. AbnormaSies may be either malig- " owe y. er ' as an feature the system by analyzing 

nant or benign, and many times the radiologist cannot ±e enlire nomogram can also automaUcaUy diagnose the 

diagnose precisely the type of abnormality frorTthe image. P^*, 0 ^ 0 ?™£LbiSf ^^ncy, with a 

Additionally, it has been established that 10-30% of women ^ 1 i i y. 

who indeed have breast cancer have negative mammograms. « In accordance with the present invention there is therefore 

THere are four possible outcomes in screening mammog- P rovided a s y stem fo [ dia S nosis of Uvin S tissu f e disea f s ; 

ra ^ r © o compnsmg a computer, a memory, an operator control 

^ v " ^ ,. . j . device, a viewing screen, and a scanning device for digitiz- 

1) True positive: Earlier detection, treatment and better mg mammograms and for applying lhe informaUon 

prognosis, 5Q to tbe computer f or storing, displaying and further process- 

2) True negauve: Reassurance of no cancer; mg computer includes circuit means enabling on-line 

3) False positive: Anxiety and time, cost and risks of more display of selected portions of a scanned mammogram as 
tests, and modified to one or more selectable features. These features 

4) False negative: Delay in diagnosis and treatment. include grey scale stretching, contrast enhancement based 
Worse prognosis. 55 on logarithmic histogram equalization, spot enhancement 

The technical interpretive expertise of the radiologist is a and magnification. The computer further includes an option 

crucial factor in effective breast cancer detection. A standard for visualization and quantification of micro-calcifications 

non- invasive procedure does not exist to diagnose a patient and mass spiculations. 

after a finding has been detected by mammography. When The invention further provides a method for diagnosis of 

there is a suspicious finding, a biopsy is frequently per- 60 living tissue diseases, including the steps of providing a 

formed. Because the information on the mammogram many digital image of a tissue to a computer; storing the digital 

times is ambiguous, in order not to miss the diagnosis of image in a memory coupled to tbe computer, displaying the 

cancers, many biopsies are performed for mammographic digital image on a viewing screen; manipulating a computer 

abnormalities. Approximately 70% of these biopsies turn out controlled pointing device for selecting a portion of the 

to be benign. 65 digital image; enhancing the image contained within the 

Although there have been many improvements in the selected portion according to one or more options from a 

mammographic equipment over the last 10 years, technical plurality of image enhancement features including grey 
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. scale* stretching, contrast enhancement basedon-logarithmic - - to a PC AT compatible microcomputer^. .The device .10. is ^ 
histogram equalization, spot enhancement and magnifica- capable of scanning mammograms of different sizes and of 
tion. The method further including steps for visualizing providing resolutions of up to 800 dots per inch, which 
micro-calcifications and mass spiculations and quantifying enables the digitization of living tissue radiograph, e.g., a 
the micro-calcifications and the mass spiculations. s breast radiograph or mammogram. Such resolution trans- 
Hie invention will now be described in connection with lales into a digital image with pixel sizes of about 30 to 40 
certain preferred embodiments with reference to the follow- microns. The microcomputer 12 communicates with an 
ing illustrative figures so that it may be more fully under- image processing board 14, having an image capacity of 
stood. 1024x1024 bits or more, which is incorporated into the 

to microcomputer 12. The board 14 includes a frame buffer 16, 

BRIEF DESCRIPTION OF THE DRAWINGS a memory 18 and auxiliary processors 20 supporting image 

processing algorithms. The output from the microcomputer 

FIG. 1 is a block diagram of the system for diagnosis of 12 may include an ^ e primer 22 a network 

living tissue diseases, according to the present invention; terminal 24 for electronic communication with other 

FIG. 2 is a flowchart illustrating the scanning process; is locations, such as other clinics. 

FIG. 3 A illustrates a grey level conversion curve used in In operation, the user first scans the X-ray or the mam- 
prior art systems; mogram by the scanning device 10. The system yields a 

FIGS. 3B, 3C and 3D illustrate grey level conversion converted digital image and displays the digital image on 

curves, according to the present invention; display 4. Display 4 displays the digitized image as well as 

FIGS. 3E, 3F and 3G are photographs illustrating 20 meous me tcxt * Display 4 receives signals which 

enhancement of contrast of an actual mammogram using represent a combination of the "VGA" mode and the 

different conversion curves according to the present inven- "Image" mode. 

tion; The user inspects the displayed digital image, to locate 

FIG. 4A illustrates a logarithmic cumulative histogram; re S ion or regions that appear to be suspicious. These regions 

ttt^c ATi Ar- a at\ u. u *ii . * are referred to as regions of interest ("ROI"). The user uses 

FIGS. 4B, 4C and 4D are photographs illustrating tU . . , . % , , « \ t 

. 4 c i i r »*v • the pointing device 8 to define a region of interest ROI on 

enhancement of grey levels of a mammogram utilizing tl _ \. , & , . 4 , . „ & , . iL 

different logarithmic histograms; ^ im ^ c ' * or exam P k ' b * m0V f.S thc f 

pointing device 8, the system draws a frame on a portion of 

FIGS. 5A, 5B and 5C are photographs illustrating result mc digital which mdudcs thc R0 I. The user then 

obtamed by utilizing different magnification factors of a 30 accordin g to me present mvenuon, chooses a spedfic image 

zoomed area; enhancement feature to enhance the image in the defined 

FIGS. 5D, 5E and 5F illustrate the pixels in the original region of interest. The operation of the enhancement process 

image and the magnified images; is interactively controlled by the user by means of the 

FIG. 6A is a flowchart illustrating spot enhancement pointing device, until the displayed appearance of the pro- 
process; 35 cessed region on the screen is optimized. Additional means 

FIG. 6B illustrates a convolution mask used in the spot can ^ used t0 magnify the whole image or specific regions 

enhancement process; thereof, so that small details can be more clearly visualized. 

FIG. 6C and 6D illustrate two tables with elements ™ cs * n ? cans 6nabl f G tb f. to point out on the 

representing the grey level value of pixels in digital image, 40 ^ un^T ^ * * ^ 

before and after convolution used in the spot enhancement " 

process; * D orci er to better characterize suspected findings and 

*r -ii. « . * , • j t_ ,1 obtain objective analysis thereof, the system also provides 

FIG. 6E illustrates a conversion curve obtained by the c J . 7 ' 7 t . 4 . F . 

. . means for quantitative measurement. The quantitative analy- 

spot enhancement process; . . r j iL ■ 1 . ■ i * 

r _ sis can be performed either on micro-calcification clusters or 

FIG. 7A is a flowchart illustrating detection and quanti- 0Q high density masscs in ^ tissuc m utilizing mcsc 

fication of micro-calcifications; means, the user defines the area containing the suspected 

FIG. 7B is a continuation of FIG. 7A; findings and chooses the features to be measured. 

FIGS. 7C and 7D illustrate examples of pixels analyzed in The enhanced information, i.e., images and the numbers 

conjunction with the process illustrated in FIGS. 7A and 7B; 50 characterizing the suspected findings, may be stored, 

FIG.8A illustrates a representation of a tumor mass on the printed, or transmitted through an electronic network to 

digital image; other physicians. Different features of the system will be 

FIG. 8B illustrates spiculations in a Binary Gradient described in further detail hereinafter, 

image of the tumor mass of FIG. 8A; Scanning Process 

FIG. 8C is a histogram of the Binary Gradient image of 55 , 

FIG 8B' and illustrated embodiment of the invention, the high 

J.^ L n • . , resolution scanning device 10 is used to scan a mammogram 

FIG. 8D is a flowchart illustrating detection and quant.- ^ ■ tQ ide a ; ^ ^ ^ 

ficauon of mass spiculations. shades of grey, within a 256 grey scale. A preferred scanning 

DETAILED DESCRIPTION OF THE DRAWINGS 60 de ™, 10 j? a line CCD 2f bed Scan Jf r Th e digital image 

is displayed on screen 4. The system 11 is used to overcome 

FIG. 1 illustrates a system 11 for the detection and the main visual restrictions of the displayed images, includ- 

diagnosis of diseases of living tissues, in particular, breast ing local low contrast, and small dimensions of suspected 

cancer. The system includes a memory or mass storage findings. 

device 2, a high resolution, non-interlaced, super-VGA 65 Typical commercial scanners have an option to control 

display 4, a keyboard 6 and a pointing device 8. The system their exposure time (E) and brightness (B). The exposure 

further includes a scanning device 10, constituting an input time is the time during which the mammogram is exposed to 
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ra. scanning light, and -the brightness-is the degree- of i lumi- 
nance of that light. Briefly, the scanning process is accom- 
plished by automatically adjusting the variable exposure 
time (E), and the variable brightness (B) of the scanning 
device 10. Typically, the scanner scans the image several 
times, preferably 3 to 5 times, while the system adjusts the 
exposure time and brightness on each scan to provide a 
digital image with an optimally high contrast. 

The operation of the scanning process according to the 
present invention is described in more detail hereinafter. The 
digital image at the output of scanning device 10 consists of 
pixels corresponding to the scanned mammogram. The 
scanning device assigns a grey level value from zero to 255 
to each pixel based on the optical density of the correspond- 
ing point on the mammogram. The optical density is the 
degree of opacity of each point on the mammogram and is 
defined as the common logarithm of opacity. Hence, a point 
on the mammogram that transmits 100 percent of the light 
has a density of zero, a point that transmits 10 percent of the 
light has a density of 1, and so forth. 

One characteristic of the scanning process, which defines 
the quality of the digital image is the brightness range, which 
corresponds to the contrast of the digital image. The bright- 
ness range is defined as the difference between the assigned 
grey levels of the darkest "black" and the whitest "white" 
points on the digital image. An image with an optimum 
brightness range is one that all the black points have a grey 
level close to zero, and all the white points have a grey level 
close to 255. 

However, with available commercial scanners, a typical 
scan of a mammogram produces a digital image having a 
brightness range that is less than the optimum attainable. For 
example, the grey level of the darkest point on the image 
might be 85 and the grey level of the brightest point on the 
image might be 150. 

The system optimizes the brightness range of the digital 
image by varying the two parameters exposure time (E) and 
brightness (B) of the scanning device according to a novel 
optimization method. 

The grey level of each pixel of the digital image varies as 
a function of the exposure time (E) and brightness (B). The 
brightness range of the digital image is defined as 

Gmax (E3)-Gmin(E,B) 
where, Gmax (E,B) and Gmin (EJB) are respectively the 
maximum and minimum grey level of pixels in the image 
scanned under a given exposure time E and brightness B. 

The range of the brightness B and exposure time E varies 
and depends on the scanning device. For the scanning device 
utilized in the preferred embodiment of the present 
invention, the brightness range of the scanning device is 
from -100 to 100, and the exposure time range is from 0 to 
255. For a given exposure time Eo, the minimal brightness 
value (Bmin=- 100) provides the minimum value for Gmin, 
i.e., (Gmin (Eo, Bmin))=min {Gmin (Eo, B)} and the 
maximal brightness vahie {Bmax=100} provides the maxi- 
mal value for Gmax, i.e., (Gmax (Eo, Bmax))=»Max {Gmax 
(Eo, B)}. Similarly, for a given brightness Bo, the minimal 
exposure time value (Emin>=0) provides the minimal value 
for Gmin, i.e., (Gmin (Emin, Bo)=min {Gmin (E, Bo)} and 
the maximal exposure time value (Emax-255) provides the 
maximal value for Gmax, i.e., Gmax (Emax, Bo)-Max 
{Gmax (E, Bo)}. 

Thus, the grey level G of each pixel of the digital image 
of a mammogram is a function of three parameters: the two 
variable parameters (E) and (B) of the scanning device 10; 
and the optical density (OD) of points on the mammogram 
or the X-ray, and is defined as 
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• *G=*f(B, E, OD). -...VU 

A novel method to optimize the brightness range is now 
described with reference to FIG. 2 A. The first part of the 
scanning process includes steps 200 and 202, which consti- 

5 tute the calibration phase of the scanning device 10. The 
system begins at step 200 when a sample film with various 
regions of known optical density is placed on the scanning 
device for scanning. The sample film is preferably a "Kodak 
photographic step table No. 1A", which has 11 steps or 

10 regions of optical density with values approximately ranging 
from 0.05 to 3.05. It is assumed that this range completely 
covers the optical density range which appears on real 
mammograms. At step 202 the scanning device 10 repeat- 
edly scans each region or step of the sample film having a 

15 given optical density while the exposure time (E) and 
brightness (B) are varied. The scanner produces a set of grey 
levels G(E,B) corresponding to each region or step of optical 
density (OD). When all the regions on the sample are 
scanned while varying the (E) and (B) values of the scanner, 

20 the system has stored a group of three dimensional tables 
each corresponding to one optical density region on the 
sample. The three dimensions are exposure time (E), bright- 
ness (B) and resulting grey level (G). The resulting group of 
three dimensional tables can be viewed in a three dimen- 

25 sional space as a plurality of spaced apart [(G),(E),(B)] 
surfaces, with each surface corresponding to a given optical 
density (OD). The resulting group of the three dimensional 
tables represents the output characteristic of the scanning 
device with respect to variable exposure time and brightness 

30 for a given range of optical density. These characteristics 
remain constant for a certain period of time, and therefore it 
is not necessary to repeat steps 200 and 202 every time the 
scanner scans a mammogram. 

At step 204 an actual mammogram is placed on the 

35 scanning device 10 to begin the scanning process. In order 
to obtain an optimum brightness range, the scanning device 
performs multiple scans as explained hereinafter. At step 
206, the values of exposure time (E) and brightness (B) of 
the scanning device 10 are set to an initial value, such that 

40 for most images, the scan yields a digital image with a fair 
range between Gmin and Gmax without getting saturation 
effects. For the scanning device used in the preferred 
embodiment, these initial values are B«60 and E=90. 
However, these values may differ from one scanning device 

45 to the other. At step 208, the scanning device scans the 
mammogram and stores the derived grey level of each pixel 
of the digital image. At step 210, the system measures the 
brightness range by taking the difference between the maxi- 
mum and minimum grey levels of the pixels in the scanned 

so image. The system then performs an optimization process at 
steps 212 and 214 to estimate new values of exposure time 
(E) and brightness (B) that will increase the brightness 
range. The process of getting the new estimates for (E) and 
(B) begins at step 212. Based on the values of (E) and (B) 

55 used to scan the mammogram, the system derives the 
extreme optical density (OD) values of the darkest and 
brightest spots on the mammogram from the three dimen- 
sional table G(E, B) which was derived during the scan of 
the film. If the system is not able to find the (OD) value 

60 corresponding to the values of (E) and (B) used during the 
scan, it estimates a value based on a standard interpolation 
routine. 

Thereafter at step 214 new estimates of exposure time(E) 
and brightness (B) are derived, based on the knowledge of 
65 the extreme optical density (OD) values in the scanned area. 
The system looks for the right combination of exposure time 
E and brightness level B, where the distance between the 
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i. .corresponding- points of two G(E,B) surfaces-of- these* two ■-. referred-to as the center of grey scale conversion curve and . 

(OD) values is maximum and where the scanner does not its Y coordinate is 127 on the new grey level scale. The 

produce saturation effects. At step 216 the system deter- center of the grey scale conversion curve is a grey level 

mines whether the current brightness range is better than the value i corresponding to the scanned image for which curves 

previous one. If so another scan of the mammogram is 5 352 and 354 convert the grey level value i to grey level value 

performed at step 208 with the new values of (E) and (B) 127 on mc new scale. The slope of curves 352 and 354 at the 

derived at step 214. Thereafter, at step 210, the new bright- ccnter of thc rcy ^ conversion curve are equal to 

ness range is measured based on the maximum and mini- ide a sm00tn connection between the two curves, 

mum grey levels obtained by the scan and new estimates of ~- * ~ 

(E) and (B) are obtained at steps 212 and 214. The system n n * ^ controls the enhancement effects in real time by 

stops the repetition of the scanning process after a prede- 10 varying the center of the grey scale conversion curve and the 

termined number of scans. In the preferred embodiment, the sloDe of tDC ^ curves 352 and 354. A smaller slope at the 

system repeats the process for five times. However, the center of grey scale conversion curve, enhances the contrast 

system can repeat the scanning and optimization process of a wider range of grey levels contained in the region of 

until no improvement in the brightness range can be interest. Conversely, a larger slope at the center of grey scale 

achieved. At step 218, the digital image is stored in memory 15 conversion curve enhances the contrast of a narrower range 

18 with the optimum brightness range obtained based on the of grey levels contained in the region of interest. In effect, 

best values of the exposure time (E) and the brightness (B) by varying the slope at the center, it is possible to control the 

of the scanning device 10. The system ends the scanning contrast in the new converted image. 

process at step 220. It is also possible to control the brightness in the new 

Once the system stores the optimum scanned image of an 20 „ , . . : * n . f ^ f ■ ,„_ # 

v . J . * . , * • converted image. For example, if the region of interest 

X-ray or the mammogram, interactive enhancement of digi- t « . . • . * .u . * i_ j • * i - 

. J i_ . i c j • • ■ appears too bright, the center of the stretched interval is 

tal mammography images can be performed in real-time Jt , L • u r tL j - * •« . . j 

, lL . i f j . j , j- , moved to the right of the curve and vice- versa. As illustrated 

both in grey levels and m pseudo color display. . ™^ -~ . , . . ■ . • . 

^ J r v J in FIG. 3D, when the center is moved to the right, more and 

GREY SCALE STRETCHING more grey levels, which originally had a high value, get new, 

In order to diagnose areas of an X-ray image or mam- 25 lower g rc y level values - ^ makes ^ Tt & on of mlerest 

mogram effectively, the digital image from the scanning look Conversely, as illustrated in FIG. 3B, when the 

device must exhibit a high contrast. In order to enhance the ccnter fe movcd t0 me left * morc and morc S re y lcvels > which 

contrast in a region of interest, the grey level distribution of originally had a low value, get new, higher grey level values, 

the digital image generated by the scanning device is opti- 30 makc s the region of interest look brighter, 

mally converted to a new grey level distribution with a better The novel process of deriving the conversion curve 350 is 

contrast in the region. The conversion yields a new image now described in more detail. Curve 352 is an exponential 

having pixels with new grey levels. This conversion is curve defined as 
referred to in the art as tone-scale transformation or grey 

scale stretching. 35 

According to one known method for grey scale stretching, W ( >° " C**-*)) 

it is assumed that all the necessary grey level information ^ ^ (i) fa a 0Q of aQ ntial from 

obtained as the result of a scan, is contained between two i.otoi=centerofgreyscaIeconversioncurve.Theboundary 

specific darkest and brightest grey levels within a predeter- conditions for Y (i) are 

mined interval. As a result of this assumption, a prior art 40 

conversion curve has the shape shown in FIG. 3A. The X Y jp)-o ; v^center)-^; d(K e (ccnter))WiWf 
axis in FIG. 3A defines the grey level values of the pixels of 

the digital image of the scanning device, and the Y axis where K is the value of the slope of curve 352 at center 

defines the new grey levels of pixels of a converted new Y^(center), and is a desired value controlled to vary the 

image with enhanced pixel contrast in the region of interest. 45 range of grey levels with enhanced contrast. The lower limit 

As demonstrated by FIG. 3 A, all grey levels outside the for K is "1" for which no visual effect exists. The upper limit 

stretching interval are discarded in the new image because for K is very high, close to infinity, for which the conversion 

their new value after conversion is zero or 255. In the yields a digital image with a very high contrast within a very 

medical context, in general and for mammographic analysis narrow range. The parameter "b" rescales Y,. on the hori- 

in particular, the details of grey levels above and below the 50 zontal axis to match the interval of "i" values from 0 to the 

stretching interval cannot be neglected. Therefore, according center. Parameter "a" rescales Y e on the vertical axis 

to the present invention, a different conversion curve has between 0 and 127. 

been developed. Curve 354 is a logarithmic curve defined as: 

Referring now to FIGS. 3B through 3D, an S-shaped grey 

scale conversion curve 350 for analyzing mammogram and 5s yXQ-255-c * (<r rf(2SS -')-l) 

other X-ray images has been illustrated. The use of the „ , , ... _ ... ... 

p u j 1 iff ft * *i_ 1 The boundary conditions for Y/i) are as follows: 

S-shaped grey scale conversion curve 350 prevents the loss J r</ 

of information at the regions outside the two specific darkest yx«nter)-i27 ; yx255)-255; d(Y^t^:))/di-K 
and brightest grey levels within a predetermined interval as 

illustrated in FIGS. 3B-3D and provides an optimum con- so where K is the value of the slope of curve 354 at Y^center), 

trast for pixels present in the region of interest. which is equal to the value of the slope for curve 352 at 

Subsequently, grey scale conversion curve 350 defines a Y/center). The lower limit for K is"l" for which no visual 

Look Up Table which converts grey level values of the effect exists. The upper limit of K is very high, close to 

scanned image into new grey level values for a converted infinity, for which the conversion yields a digital image with 

image with enhanced contrast in the region of interest. 65 a very high contrast within a very narrow range. 

Curve 350 is derived from two separate curves 352 and During the operation of the system, a user may select the 

354 connected together at point 356 whose X coordinate is region of interest by pointing device 8 and keyboard 6, and 
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mthen activatetbe grey scale stretching function of the system. r 
Microcomputer 12, prepares an initial conversion table 
according to curve 350 of FIG. 3C, by automatically select- 
ing a center and a slope for conversion curve 350. 
Thereafter, the user may change the conversion curve by 
selecting a new center and slope depending on the image 
characteristics in the region of interest, based upon the 
process described above. 

In order to determine the initial conversion curve 350, 
when the grey scale stretching function is first activated, 
microcomputer 12 generates the histogram of grey levels in 
the region of interest. The system selects two grey level 
values gj and g 2 so that 10% of the pixels in the region of 
interest have original grey level values below gj and 10% of 
the pixels in the region of interest have original grey levels 
above g 2 . The parameters "center" and "slope" which deter- 
mine the new grey scale, are chosen in order to allocate 80% 
of the new grey levels scale to the original grey level values 
between gi and g 2 . Thereafter, the curve can be changed 
interactively by keyboard 6 or pointing device 8. 

The pointing device 8 controls the contrast and brightness 
of the new converted image by moving vertically and 
horizontally. The coordinates of the pointing device are 
defined as Mx and My, where: l<Mx<254, and 0<My<253. 
The value of Mx denotes the desired value for the center of 
the stretching interval and the value of My denotes the 
desired slope. The slope is derived from: 

slopes (*/4.+Afy* nJ(4*21G))^K 

The brightness of the new converted image varies by con- 
trolling the value of the center. Similarly, the contrast in the 
new converted image varies by controlling the value of the 
slope. 

The grey scale stretching process is entirely controlled by 
the user and as such it enables the concentration on specific 
details by enhancing their contrast, as can be clearly seen in 
FIGS. 3E, 3F and 3G comparing the actual images obtained 
from a single mammogram, when using different portions of 
the curve 350. 

Another feature of the present invention is color-grey 
scale stretching based on the grey scale stretching discussed 
above with the use of RGB components for obtaining 
pseudo color display. The grey levels of the original image 
are thus converted in such a way that white, which means 
high grey level, remains white, and black, which means low 
grey level, remains black. All the remaining grey levels 
between white and black are converted into pixels with 
different colors according to combination of RGB compo- 
nents, feels with lowest grey level after black, become 
green. As the value of grey levels increase the colors change 
to blue, violet, red, orange, yellow and finally white. Red, 
orange and yellow are defined as hot colors, and green, blue 
and violet are defined as cold colors. Thus pixels with low 
grey level value turn into cold colors and pixels with high 
grey level value turn into hot colors. 

The RGB coloring is achieved through the use of a look 
up table, which allows the conversion of grey levels into 
different shades of color, based on the grey level value of 
each pixel. 

LOGARITHMIC VARIABLE HISTOGRAM 
EQUALIZATION 

Another method used for improving the visual contrast of 
a digitized image is histogram equalization. The prior art 
histogram equalization method, known as uniform histo- 
gram equalization, improves the visual contrast by creating 
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a transformed image with a- flat histogram;. Histogram equal--> 
ization can be accomplished by using a transformation 
look-up table applied to each pixel in the digitized image. It 
has been found that the transformation look-up table, which 

5 yields a transformed image with a flat histogram, is the 
scaled version of the cumulative histogram of the original 
digital image. The cumulative histogram is a graph of the 
sums of numbers of pixels, along the vertical axis, having 
grey level values equal to or less than the grey level values 

10 along the horizontal axis of the graph. 

The histogram equalization method described above may 
not be appropriate for enhancing images on a mammogram 
where in some instances the purpose is to detect and 

!5 accentuate bright spots in regions of interest (ROI) in the 
digital image against the background. Typically, these bright 
spots may correspond to regions of micro-calcification. 
Therefore it is desired to have a transformed image with a 
histogram that has a relatively large number of pixels with 

20 low grey level values, so that the remaining pixels with 
higher grey level values appear with a better contrast. In 
order to achieve a transformed image with such a desired 
histogram, the system implements a logarithmic histogram 

25 equalization as described hereinafter with reference to FIG. 
4A. 

According to one aspect of the present invention, the 
system creates a new grey scale based on a variable loga- 
rithmic histogram equalization in the region of interest 

30 ("ROI") of a digital image. After the equalization process, 
the transformed image will have a cumulative histogram 
CH(x), that closely approximates one of the many exem- 
plary cumulative histogram curves CH(x) as illustrated by 

35 curves 370 of FIG. 4A. The cumulative logarithmic histo- 
grams are defined as: 

CH(x) = [C//(255) - CH(0)} * | ffi^ | + CH(0) 

40 

where "x" is a grey level value between 0 and 255, "q" is the 
parameter of each curve 310, which defines the degree of 
concavity of the graph, CH(255) is the total amount of pixels 
in the region of interest, after equalization CH(0) is the 

45 number of pixels with grey level value zero after equaliza- 
tion and Ln is natural logarithm as illustrated in FIG. 4A. 
Curves 370 take a different shape as the value of q varies. 
The system constructs a look-up table which transforms 

50 me S rev * eve l values of the digital image in the region of 
interest into new grey level values with a specified cumu- 
lative logarithmic histogram according to equation (1) by 
utilizing an iterative process. Thus, the system iteratively 
calculates a plurality of look-up table transformations. The 

55 look-up table transformation that yields a converted new 
image with a cumulative histogram that most closely 
approximates the specified cumulative histogram is then 
selected. Since the cumulative histograms are logarithmic, 
the look-up table transformation curve is preferably expo- 

50 nential. 

In an alternative embodiment, the system constructs a 
look-up table in accordance with the relationship: 

LUT(x}=*er-l (2) 

65 

where LUT(x) is the look-up table transformation function 
and, p, a function of q, is defined as 
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ch(x) - ck(0) 
ch$55) - ch(0) 



•Ln(256) 



where ch(x) is cumulative histogram of the digital image io 
the region of interest before transformation and ch(255) is 
the total number of pixels in the region of interest and ch(0) 
is the number of pixels with a grey level value of zero in the 
region of interest. Furthermore: 

ch(0)=CH(0) and cA(255>C//(255) 

Thus, the look-up table also varies as a function of q. In 
one embodiment of the present invention, the user can 
modify the logarithmic histogram equalization by providing 
a desired value of q via keyboard 6 or pointing device 8 of 
FIG. 1. The value of q can vary by moving the pointing 
device 8 along either a horizontal direction or a vertical 
direction. For example, if q varies based on the horizontal 
movement of the pointing device 8, the movement of the 
pointing device along the X axis is translated to a linear 
sliding of curve 310 along line 312 of FIG. 4A, by relation- 
ship: 



Ln 



(-*) 



10 



15 



20 



La (256) 



where mx is the grey level value corresponding to a given 
coordinate of the pointing device 8 along the horizontal axis. 
The value of mx is a function of the coordinates of the 
pointing device 8 along the horizontal axis and ranges from 
0 to 255. The initial logarithmic curve 310 and the corre- 
sponding look-up table are determined according to an 
initial predetermined value for mx. When the system first 
activates variable logarithmic histogram equalization, it 
assigns a predetermined reference value to mx regardless of 
the initial coordinate of the pointing device 8. Thereafter the 
value of mx increases when pointing device slides to the 
right and decrease when pointing device slides to the left. In 
one embodiment, the initial predetermined value for mx is 
120. 

The logarithmic histogram equalization described above 
allows the control of the contrast in the region of interest. 
The brightness adjusts appropriately as different curves 310 
are used to obtain a look-up table transformation function. 
FIGS. 4B, 4C and 4D illustrate the effect on the grey scale 
transformation by varying the value of q. As seen in FIG. 4C, 
a moderate logarithmic effect leads to an equal utilization of 
all grey levels, a result that is similar to a transformation 
based on uniform equalization. A stronger logarithmic effect 
will emphasize toe brightest details in the region represent- 
ing micro-calcifications as illustrated by FIG. 4A. 

It can be appreciated that rather than calculating the value 
of q and the look-up table in accordance with the equations 
described above, it is possible to construct different look-up 
tables for converting the value of mx into appropriate values 
of q, p and LUT(x). 

SPOT ENHANCEMENT 

Another novel feature of the present invention is spot 
enhancement which is most effective when applied to 
regions with low contrast and relatively small size. The 
system checks the grey level difference between each pixel 
and its neighboring pixels within a region of interest. The 
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system- then modifies these differences so that, large* grey 
level differences between a pixel and its neighboring pixels 
are diminished and small grey level differences between a 
pixel and its neighboring pixels are accentuated. This pro- 
cess leads to an enhancement of "pixel to pixel" contrast in 
the region of interest defined by the user. 

According to one embodiment of the present invention, 
the spot enhancement process begins at step 400 of FIG. 6 A, 
by filtering the digital image of a region of interest. For each 
grey level value of a pixel in the digital image the filter 
provides another grey level value whose magnitude is the 
average of weighted sum of grey level values of its neigh- 
boring pixels. The filtering process constitutes a convolution 
on the digital images with a convolution mask 440 having 9 
cells as illustrated in FIG. 6B. The convolution mask mea- 
sures the average value of the eight pixels 442 surrounding 
each pixel 444 in the digital image. Each cell surrounding a 
pixel has an assigned weight which in this case is the value 
"1". However, each cell can have other weighted values. At 
step 402, in FIG. 6A, the process of convolution begins for 
all pixels in the region of interest. 

The outcome of the convolution can be visualized by 
referring to FIGS. 6C and 6D. FIG. 6C illustrates a table 
corresponding to an original digital image of the region of 
interest. Each element 446, 448, 450 and 452 of the table 
represents grey level values corresponding to the pixels of 
the original digital image of the region of interest. FIG. 6D 
illustrates a second table with the outcome of the convolu- 
tion. Each element 446', 448', 450' and 452' of the second 
table represents the new grey level values, each new grey 
level value being the average of grey level values of eight 
pixels surrounding a pixel with grey level values illustrated 
in FIG. 6C. 

Returning now to FIG. 6 A, at step 404, the system stores 
the filtered table of FIG. 6D with all the grey level values 
derived by the convolution. The filtered table referred to in 
FIGS. 6A and 6D is defined as the convoluted region of 
interest or CROI. At step 406, the system creates a contrast 
table p(f ( ,g.) where f f is the grey level value of pixels in the 
original digital image and gj is the grey level value of the 
corresponding pixel in the convoluted region of interest 
CROI. The difference in grey level value between each pair 
represents the amount of contrast between each pixel and its 
neighboring pixels. 

At step 408 the system begins the process of creating a 
look up table by obtaining the first pair in the contrast table. 
At step 410 the system gets the next pair in the contrast table 
and compares it with the first pair. For purposes of 
illustration, the first pair is defined as pl(fl,gl) where fl is 
the grey level value of a pixel in the digital image and gl is 
the average grey level value of its surrounding eight pixels. 
For example, fl. may be element 446 in FIG. 6C and gl may 
be element 446' in FIG. 6D. The second pair is defined as 
p2(£2,g2) where f2 is the grey level value of another pixel in 
the digital image and g2 is the average grey level value of 
its surrounding eight pixels. For example, f2 may be element 
448 in FIG. 6C and g2 may be element 448' in FIG. 6D. 

At step 412 the system determines whether there is an 
overlap between the first pair and the next pair in the table 
by comparing the f and g values of each pair with each other. 
An overlap constitutes the situation when f and/or g values 
of one pair are between the f and g values of the other pair. 
If there is an overlap, the system goes to step 416, eliminates 
the two pairs and creates a new reduced pair which substi- 
tutes the eliminated pairs. 

The criteria for creating the new reduced pair is described 
hereinafter. Assuming that pi and p2 overlap, the process 
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looks.-ahtbe four values in the* two pairs and:selects the actuaL-image displayed on the monitor, e) when the magni-*, 

middle two numbers as the values for the reduced new pair. fication factor is not an integer number, the grey level 

For example, if 0=110, gl=180, £2=80 and g2=130, then the assigned to each pixel is a result of the interpolation of the 

middle two numbers are 110 and 130. The reduced new pair grey levels of all the surrounding original pixels. This 

gets these two numbers. The system then makes the reduced 5 feature enables the preservation of the exact proportions 

new pair as the first pair of the contrast table. Furthermore, among the elements in the zoomed area. Additionally, it 

in the case where the values of one pair are included within attenuates the digitization effect in case of high magnifica- 

the values of the other pair, the smaller pair is kept as the first tion factor. 

pair and the larger pair is removed. At step 418 if there are The system performs the zooming process by displaying 

more pairs remaining for further comparison the system 10 ca ch pixel in the original image by a larger number of pixels, 

goes to step 410 until all pairs in the contrast table have been FIGS. 5D and 5E illustrate an example when the system 

compared. The system then goes to step 420. magnifies the image by a factor of 2. Each pixel in the 

If at step 412 the system determines that there is no original image SD is represented by its grey level value, 

overlap between the first pair and the next pair, the system Circles 380 in each pixel cell 382 in FIG. 5D represent the 

checks for more pairs at step 414 and if there are no more 15 size of each pixel in the original image, 

pairs remaining in the contrast table the system goes to step Pixels in the enlarged image 5E are also represented by 

420. If however, there are more pairs remaining in the their grey level values. As illustrated, each pixel in the 

contrast table, the system goes back to step 410 for further original image 5D is displayed by four pixels in the enlarged 

comparisons until all pairs in the contrast table have been image in FIG. 5E. Each of the four pixels in FIG. 5E has the 

compared with the first pair. 20 same g^y i eve j va j ue ^ lne original p i xe i m piG. 5D. 

At step 420, the system stores the first pair in an input pair Circles 380' represent the size of each pixel in the enlarged 

table and eliminates that first pair from the contrast table. image. 

The system then takes the next pair in the contrast table and When the zooming factor is not an integer, the grey level 

makes that pair the first pair of the contrast table. At step of pixels in the magnified image are derived by interpola- 

422, if there are more pairs remaining in the contrast table, 25 tion. FIG. 5F illustrates an image which has been enlarged 

the system goes to step 408 and begins the process again. by a factor of 1.5. Each pixel occupying a cell in the original 

If however all possible reductions have been made, the image requires 1.5 cells in the magnified image. The grey 

input pair table is complete and the system goes to step 424 level value of pixels occupying the additional cells 382 is 

to make a look up table. FIG. 6E illustrates a look up table 3Q equal to the average value of the grey levels in the neigh- 

462 which is a step function. The input of the look up table boring cells. Circles 380" represent the size of each pixel in 

is the grey levels of the digital image of a region of interest the enlarged image. 

and the output is the converted grey levels creating an SEGMENTATION AND EVALUATION OF 

enhanced image. In order to denve the incremental steps 460 k a K m „ tn „ n t nT „„ „ „™„ ^ , m „„ 

along the i axis of the table, the system counts .be number 3J MAMMOGRAPHY MICRO-CALCIFICATIONS 

of the pairs in the input pair table and divides 255 by the An additional feature of the present invention is the ability 

number of the pairs to get a value "dl." For the intervals to determine the structural features of micro-calcifications 

defined by each pair, the table converts the grey level values and evaluate those features to assist in the diagnosis of 

within that interval into new values, which are linearly malignant micro-calcifications. 

distributed within the increment "dl" along the i' axis. Grey ^ The first step in diagnosing micro-calcifications is to find 

level values between two pairs are converted into a fixed an indication of their presence on the mammogram. Because 

value. FIG. 6E illustrates an example of the intervals 464, micro-calcifications have a lower optical density than the 

466, 468, 470 and 472, within which grey level conversions ordinary tissue, they appear on the mammogram as small 

occur. As can be seen, a large grey level difference between regions that are brighter than the surrounding region. Many 

a pixel and its neighboring pixels as illustrated by pair 470 45 times these small regions are located closely together and 

is diminished and a small grey level difference between a form a cluster. 

pixel and its neighboring pixel as illustrated by pair 466 is la many occas i onSj cer tain structural characteristics of 

accentuated. Remarkably, the overall result is an image with individual micro-calcifications and micro-calcification clus- 

an unproved contrast. ters can prov ide valuable diagnostic information. For 

, 50 example, micro-calcifications that appear much brighter 

agni cation maQ ^ grounding region or have a smooth perimeter, tend 

In addition to the above-described optional features, the to be benign. Other micro-calcifications that appear to have 

system also provides the option of what is called in the art brightness very close to the surrounding region or have 

of photography "zooming". The zooming may be effected highly irregular shape tend to be malignant. Thus, it is very 

with either a circular or square or any other shape of a 55 difficult to identify malignant calcifications. Further, since 

predetermined area on the image, as seen in FIGS. 5A, SB not every bright detail on the mammogram represents a 

and 5C The zooming process has many features and advan- micro-calcification, a radiologist's experienced eye is 

tages and can be advantageously utilized as follows: a) The required to ascertain that a suspicious spot corresponds to a 

dimension of the zoomed area can be changed interactively micro-calcification. Based on the structural characteristics, 

in real time; b) the location of the zoomed area on the image 60 the radiologist determines whether the micro-calcifications 

can be changed interactively in real time; c) the magnifica- are malignant. 

tion factor of the zoomed area can be changed interactively Many times, the difference in grey level between a 
in a continuous manner, i.e., without abrupt changes, in real micro-calcification and the surrounding region is not dis- 
time, as can readily be seen in FIGS. 5A to 5C; d) if the cernable by human eyes. The radiologist, by applying the 
image is presently displayed on the monitor in a reduced 65 image enhancement features described before, including 
form (i.e., lower resolution), the zooming processes uses the grey scale stretching, spot contrast enhancement, logari Un- 
original image in its highest available resolution and not the mic grey scale equalization and magnification, views the 
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-digital image.-.The: image, exhibits a.bettercontrast. as a- result -a. .-the image,-the system, first subtracts the backgroundiinfor- ; 

of these enhancement features. This assists the radiologist to mation from the original digital image. This is accomplished 

identify suspicious areas on the mammogram image that by filtering the digital image using a convolution mask. The 

may contain micro-calcifications. convolution mask preferably is a square and symmetric 

As an additional feature to identify micro-calcifications, 5 matrix filled with "l"s. 

the system allows the radiologist to determine the grey level sizc of mc mask ^ obtained, in pixels, in accordance 

value of a given pixel. This allows the radiologist to compare ^ the scanning resolution and the maximum average size 

quantitatively the densities of two areas, to identify areas in of micro-calcifications which is about 0.45 mm, following 

increased optical density that may not be apparent due to me relationship 

surrounding high density tissue. 10 

Another feature that assists the radiologist to identify *[pise!s]° 045 DPi 
micro-calcifications is a display of grey levels along a given 

line or the image. The radiologist by using the pointing _ . 
device 8 of FIG. 1, defines a line on the image. The grey ™™ X "» ,he ^ of mc "nw**™ made for the 
level value of all the pixels along the defined line is then 15 background suppression routine, in pixels, and DPI is the 
displayed on the screen. This allows the radiologist to ^solution of the scanning process in dots per inch This 
compare quantitatively the densities of the points along the 13 dm ^ e d 2S * m ^ ch 10 y ield the ^solution 
defined line to identify points with increased optical density m dots P" The 0.45 mm represents the maxi- 
mal may not be apparent due tome sunoundmg high density mum av « a S e *» of a micro-calcification region Because 
tissue 20 resulting filtered image could be noisy, the system 

. . . , . 0 . preferably applies an additional low-pass filtering, after 

The radiologist ; by usmgthepointingdev.ee 8 .causes toe ^ ^ d £ „ ^ , 3x3 ^ 

sys em to draw a frame on a porton of the digital image that ^ background suppressed image, the sys- 

mcludes ^suspicious area and is referred to as the region tem ^ ^ ofTdentifying micro^alcmcations in 

of mterest ROI. The system then engages ^processing the a ^ of interest (ROI) in the toage. At step 502 the 

image defined by the region of interest ROI. In order to ♦ . i * • ( a ♦* /ka^\ *l 

i * • . »u <r * c*u u i j- *i- system looks for micro-calcifications (MC) on the mammo- 

eliminate . the effect of the background image on the . appear- » >|n which SQme C0Dn ^ ctive ; set of micr0 . 

ance of the spots that represent a micro^alcincatioo, the calcificatioQ ae]s accordin , Q the 

system first applies a background suppression routine in the 

whole digital image. Based on the background suppressed 3Q gl(mc\ 

images, the system allows the operator to define the micro- gl(r-mc) >k>0 
calcifications interactively, in real time, by trimming a grey 

level threshold. All the pixels above the grey level threshold ^ T ■ i i e * i .i_ 

• . ii* i_ 4 i c li l i • i Where GL is the grey level of a pixel or the average grey 

are highlighted pc&nUy by color as micro-calcification^ ^ for a ^ of ? ^ MC ^ , micro ^ alci | ca ^ on 

By lowering the threshold, more micrc^calcifications can be „„ u • *• . * • i -j .-c j 

/ , ^ , . - - .... . u , 35 having a connective set of pixels identified as micro- 
viewed. Conversely by raising the threshold, less micro- t *• • i *.l i i l. i i 
. . - A . l - j calcification pixels with grey levels above a given grey level 
calcifications can be viewed. . T i_ ™r t n f n 

threshold M and a diameter between 0.05 mm to 0.5 mm. R 

Once the threshold trimming method localizes the micro- ^ a rcgion on the mammogram that conlains micr0 _ 

calcificaUons, the system performs a novel "region growing* calcifications MC, and K is a given positive value. The 

process to estimate the contour of the micro-calcifications ^ diameter of a m i cr o-calcification MC is in the range of 0.05 

and produce an image having spots representing micro- to 0 5 mm 

calcifications which closely approximate the contour of the 0nce m i cr o-calcifications MC in regions R have been 

actual micro-calcifications in the breast tissue. Thereafter, ident ified, they can be visualized on the system's screen 

the system calculates various structural parameters associ- preferably by a given color such as blue or red. The 

ated with individual micro-calcifications and micro- 4S m i C ro-calcifications MC appear as bright spots in the region 

calcification clusters. By comparing the calculated param- Q f Merest 

eters with a set of statistically significant parameters that ^ systcm a]so quaDlifies the m i cr o -calcifications MC by 

have been previously dcnveo\ a physician can ascertain cslimating lheir ^tonr and by calculating certain relevant 

malignancy of the micro-calcincaUons. parameters associated with each micro-calcification or 

In the alternative, the system automatically analyzes the 50 micro-calcification clusters. A novel aggregation technique, 

digital image of a mammogram and determines the presence or "region growing," is used for this purpose. First, an initial 

of micro-calcifications. The system then applies the "region subset of micro -calcification pixels with grey level values 

growing" process to define the contour of the micro- exceeding a given number is selected and defined as current 

calcifications and thereafter calculates various structural set of calcium pixels or "current calcium set" (CCS). The 

parameters associated with individual micro-calcifications 55 CCS is the subset of micro-calcification pixels which are 

and micro-calcification clusters. The calculated parameters considered to belong to a micro-calcification MC at a certain 

are then compared with a set of statistically significant step of me process. At step 504, for each micro-calcification, 

numbers to determine whether a particular micro- the brightest pixel is selected, together with its eight nearest 

calcification or a micro-calcification cluster, identified by the neighbors, to form the "growth initiator" (GI)region. The GI 

system, is malignant or benign. 60 region is the place from which the pixel aggregation starts. 

The process of identifying and quantifying micro- It can be appreciated that the growth initiator region can 

calcifications is described in more detail hereinafter. As have various sizes. 

illustrated by FIGS. 7A and 7B, the system begins the The system by applying the region growing method of the 

segmentation and evaluation of micro-calcifications at step present invention considers and analyzes a certain number of 

500 by first performing a background suppression routine to 65 pixel sets as defined hereinafter. One set that the system 

the digital image of the mammogram. Since the micro- considers is the CCS described above. The set of other pixels 

calcifications appear against a non-uniform background in adjacent to the current calcium set CCS is referred to as the 
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• adjacent set (AS). The AS pixels form. the external bound- -,r„.step.520ithe *system~detennines; whether. GL(PUC) -is -less.- 

aries of the current calcium set CCS. The system then than Tmin. If so, at step 522, the system determines that the 

analyzes each pixel in the adjacent set (AS). Each analyzed pixel under consideration PUC is not to be added to the 

pixel is referred to as the pixel under consideration or current calcium set. Tmin is a predetermined threshold, 

(PUC). Another subset that is considered by the system is the 5 which according to toe preferred embodiment of the present 

set that includes the pixel under consideration PUC and its invention has two values as follows: 
nearest eight neighbors, referred to as S9. Another subset is 

the set that only includes the nearest eight neighbors of the * GL(h)>is then 7mtn=9 

pixel under consideration PUC, referred to as S8. Finally the gl(H)<16 ihen Tmin=A 

number of pixels in S8 that do not belong to the current 10 CD 

calcium set CCS is referred to as Mo (number of outer where GL(b) is the grey level value of the brightest pixel in 

pixels), and the number of pixels in S8 that belong to the me current calcium set (CCS) 

current calcium set CCS is referred to as Ni (number of inner M step 524) ^ system determines whether the grey level 

pixels), such that No+Ni«8. value of ±e pixd wdet co nsidcrat i on GL(PUC) is larger 

The region growing method is now explained in further is man Xmax |f ^ at stcp 526 lhc systcm adds thc current 

detail. At step 506, the system identifies an adjacent set (AS) pixd mdeT consideration PUC to the current calcium set 

of all pixels that are adjacent to the current set of calcium ccs Xmax is a predetermined threshold, which according 

pixels (CCS). The system then considers each pixel in the to the pre f erre d embodiment of the present invention is 27. 

adjacent set (AS) to decide whether it should be added to the If> howeverj none of the ^ i through 3 apply, the system 

current set of calcium pixels (CCS). At step 508 each pixel 20 goes to step 528 t0 measure GLi and GLo values. GLi is the 

in the adjacent set (AS) is retrieved for consideration. average grey level value of the inner pixels Ni (where Ni is 

Depending on a certain criteria as illustrated in steps 510 me number 0 f S8 pixels that belong to the current calcium 

through 578, the system determines whether or not the ^ aQd GLo ^ me average grey level value of ^ outer 

retrieved pixel under consideration (PUC) should be aggre- pixels No (where No ^ mc numbcr of ^ pixeIs QOt 

gated into the current calcium set (CCS). Once all the pixels 25 belonging to the current calcium set CCS), 

in the adjacent set have been considered, the system based ^ systcm at stcps 530 through 578 considers six dif- 

on the aggregated pixels defines a new current calcium set ferent possi ble cases depending on the relationship of the 

( ccs )- three parameters GLi, GLo and GL(PUC) to one another. 

As illustrated by step 580, this process is repeated until first case ^gins at step 530 at which ^ the system 

the final set of current calcium pixels (CCS) is the same as 30 determines whether GL(PUC)<GLo<GLi. If so at step 532 

the previous set of the current calcium pixels (CCS). This ±t system determines that the current pixel under consid- 

indicates that no pixel in the adjacent set (AS) can be added eration PUC ^ not to 5e added to currens ca i dum M C CS. 

to the CCS and that the micro-calcification (MC) cannot ^ ^ cond case begins at slep 534 at which poiat the 

grow any further. The system repeats this process for each system determilies whether GL(PUC)<GLi<GLo. If so at 

micro-calcificationMC The resultmg final "current calcium 35 step 536 mc system gocs tQ proccss A At step 554> (he 

sets" (CCS) define contours that closely approximate the systcm ^gins thc process A by going to step 556 to 

actual contours of micro-calcifications in the breast tissue. determine whether 

Io order to determine whether a pixel under consideration 

PUC should be added to the current calcium set, the system CLjPUC) 

applies four separate rules to each PUC. At step 510, rule 1 40 gu " m 
is applied. If No<3 (where No is the number of S8 pixels not 

belonging to the current calcium set CCS), the pixel under where TO ^ a mres hold ratio constant and represents the 

consideration is within the "cavern" and is considered as an value of lhe ratio of two grey leve i s be low which the two 

aberration in the image. The system at step 512 adds the grey levels cannot be considered close to each ot her. In the 

pixel under consideration PUC to the current calcium set 45 preferred embodiment of the present invention TR is 0.8. If 

CCS without any other consideration. FIG. 7C illustrates a a , step 556 the system d e le rmines that the grey level value 

situation where rule 1 is satisfied. Pixels 600 represented as of the currcnt pixel under consider ation GL(PUC) is not 

filled dark blocks belong to the current calcium set, and No, close t0 GLi (the ave rage grey level value of the inner pixel 

the number of pixels that do not belong to the CCS, is equal Ni)> then it goes to step 564 where u determines that the 

t0 50 current pixel under consideration is not to be added to the 

At step 514, the system applies rule 2. If No >5 (where No current calcium xl ccs otherwise, GL(PUC) is considered 

is the number of S8 pixels not belonging to the current close h t0 GU and the s t0 st 558 to 

calcium set (CCS)), the pixel under consideration PUC is an determine whether 
asperity and is considered as border noise. The system at 

step 516 determines that the pixel under consideration PUC 55 GLi>n 
is not to be added to the current calcium set (CCS). FIG. 7D 

illustrates a situation where rule 2 is satisfied. Pixels 600 where Tl is a given threshold value. In the preferred 

represented as filled dark blocks belong to the current embodiment the value of Tl depends on the grey level value 

calcium set, and No, the number of pixels that do not belong of the brightest pixel in the current calcium set (CCS) as 

to the CCS, is equal to 6. 60 follows: 

Rules 1 and 2 described in connection with steps 510 

through 516 are based on the morphology of the micro- KGL{h)>is thenn-n 

calcification pixels. If rules 1 and 2 do not apply, the system # gl(H)<u then n=»5 
then goes to step 518 to apply rule 3 which is based on the 

grey level value of the pixel under consideration GL(PUC). 65 Therefore, if GLi>Tl then the system goes to step 560 to add 

This rule applies if 2<No<6 (where No is the number of S8 the current pixel under consideration to the current calcium 

pixels not belonging to the current calcium set (CCS)). At set. Otherwise the system goes to step 562 and the current 
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.pixel under consideration PJUCis. not iaddedao, the* current* 
calcium set CCS. 

The third case occurs at step 538 when the system 
determines whether GLi<GLo<GL(PUC). If so, the system 
at step 540 adds the current pixel under consideration PUC 
to the current calcium set CCS. Otherwise, the fourth case 
begins at step 542, where the system determines whether 
GU<GL(PUC)<GLo. If so, the system at step 544 adds the 
current pixel under consideration PUC to the current cal- 
cium set CCS. Otherwise, the fifth case begins at step 546, 
where the system determines whether GLo<GL(PUC)<GLL 
If so, the system goes to step 548 to begin the process B. 
Process B begins at step 566. By going to step 568 the 
system determines whether: 



GLjPUQ 
GLi 



■ TR 



20 



35 



where TR is a threshold ratio constant and represents the 
value of the ratio of two grey levels below which the two 
grey levels cannot be considered close to each other. In the 
preferred embodiment of the present invention TR is 0.8. If 
at step 568 the system determines that the grey level value 
of the current pixel under consideration GL(PUC) is not 
close to GLi (the average grey level value of the inner pixel 25 
Ni), then it goes to step 576 where it determines that the 
current pixel under consideration is not to be added to the 
current calcium set CCS. Otherwise, GL(PUC) is considered 
close enough to GLi and the system goes to step 570 to 
determine whether: 30 

GLi>T2 

where T2 is a given threshold value. In the preferred 
embodiment the value of T2 depends on the grey level value 
of the brightest pixel in the current calcium set (CCS) as 
follows: 

If GL(h)>\S then 72-16 

If GL(h)<16 thco 72-8 

40 

Therefore, if GLi>T2 then the system goes to step 572 to add 
the current pixel under consideration (PUC) to the current 
calcium set (CCS). Otherwise the system goes to step 574 
and the current pixel under consideration PUC is not added 
to the current calcium set CCS. 45 

Finally, the sixth case occurs at step 550 where the system 
determines whether GLo<GLi<GL(PUC). If so the system 
at step 552 adds the current pixel under consideration PUC 
to the current calcium set CCS. Otherwise, the current pixel 
under consideration (PUC) is not added to the current 50 
calcium set CCS. After considering all the pixels in the 
adjacent set as described above, the process yields a new 
current calcium set and a new adjacent set AS. The system 
goes back to step 508 and repeats he process until no pixel 
from adjacent set AS can be added to the current calcium set. 55 
Once it is determined that the CCS cannot grow any further, 
the system ends at step 582. 

Once the contour of each micro-calcification MC in the 
region of interest ROI is determined, the system calculates 
six parameters associated with each micro-calcification MC. 60 
Furthermore, the system calculates other parameters asso- 
ciated with a micro-calcification cluster within the region of 
interest. 

The six parameters that characterize each individual 
micro-calcification are: (1) brightness; (2) area; (3) length; 65 
(4) shape factor according to a first alternative referred to as 
SF1; (5) shape factor according to a second alternative 



* -referred to as SF2;.and (6) distance to- tonearest neighbor-.-* 
ing micro-calcification MC. For each parameter, the system 
calculates the average value over all the micro-calcifications 
MC in the region of interest based on standard arithmetic 

5 methods. Further, the system calculates the average value by 
measuring the mean of the two extreme values in the set. In 
addition, the system measures the standard deviation of each 
parameter based on known statistical methods. Finally, the 
system measures the standard deviation based on the differ- 

10 ence between the two extreme values in the set divided by 
2. 

The first parameter, the brightness of each micro- 
calcification MC is the average value of grey level values of 
all pixels in the micro-calcification MC. The second 
is parameter, the area of each micro-calcification MC is the 
number of pixels in the region, defined in square millime- 
ters. 

The third parameter, the length of the micro-calcification 
MC is the maximum distance between two pixels in the 
region, expressed in millimeters. The length between two 
pixels is obtained by the relationship: 



■ _ AT* 25.4 
DPI 

where L is the length between two pixels in millimeters, N 
is the number of pixels representing the Euclidian distance 
between the two pixels and DPI is the scanning resolution in 
dots per inch. 

The fourth parameter, the shape factor (SF1) according to 
the first alternative is obtained by the relationship: 



SFi* 



P 2 

$ 



where P is the perimeter of the micro-calcification MC and 
S is the area of the MC. 

The fifth parameter, the shape factor (SF2) according to 
the second alternative is obtained by the relationship: 



SF2- 



where Re ff is the effective radius of the micro-calcification 
MC and S is the area. In order to obtain the effective radius, 
first the system derives the coordinates of the pixel which 
constitutes the center of mass of the micro-calcification MC. 
The center of mass coordinates Xc and Yc are respectively 
the average of the x and y coordinates of all the pixels in the 
micro-calcification MC. The effective radius is calculated by 
the relationship: 



1 N r+ — . 
-77 2 



i-1 



\Ri -Rc\ 



where Ri is the radius vector (Xi, Yi) of each pixel in the 
micro-calcification and Rc is the radius vector (Xc, Yc) of 
the center of mass of the micro-calcification and N is the 
total number of pixels in the micro-calcification. 

Finally, the sixth parameter, the distance to the nearest 
neighboring micro-calcification, is the smallest distance 
from a given center of mass of a micro-calcification to the 
center of mass of other micro-calcifications in a cluster. 

Table 1 illustrates the parameters describing the micro - 
calcifications in the region R as described above. The letter 
"E" in the table denotes the alternative calculation method of 
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*■ ^average and tbeistandardideviation -.as. described above. :^ 
These parameters assist in the diagnosis of micro- 
calcifications observed on a mammogram. The value of each 
parameter is compared, either manually or automatically by 
the system, with statistically derived values to determine < 
whether the observed micro-calcifications are malignant or 
benign. 



TABLE 1 



PARAMETERS FOR CHARACTERIZING 
MICRO-CAIXIFICATION CLUSTERS IN MAMMOGRAMS 
These characteristics are individually calculated 
for each m icro-cal ci fication in the cluster, 
and then averaged over the whole cluster. 



10 



Average Brightness 
Deviation of Brightness 
Average Brightness (E) 
Deviation of Brightness (E) 
Average Area 
Deviation of Area 
Average Area (E) 
Deviation of Area (E) 
Average Length 

Deviation of Length 

Average Length (E) 

Deviation of Length (E) 



Average of Shape Factor 1 
Deviation of Shape Factor 1 
Average of Shape Factor 1 (E) 
Deviation of Shape Factor 1 (E) 
Average of Shape Factor 2 
Deviation of Shape Factor 2 
Average of Shape Factor 2 (E) 
Deviation of Shape Factor 2 (E) 
Average of Distance to the Nearest 
Neighbor 

Deviation of Distance to the 
Nearest Neighbor 
Average Distance to the 
Nearest Neighbor (E) 
Deviation of Distance to the 
Nearest Neighbor (E) 



20 



The next group of parameters are associated with the 
structure of a micro-calcification cluster. These parameters 30 
are based on adjacent line segments, within the cluster, that 
connect pairs of micro-calcifications, which according to a 
predetermined criteria are considered "adjacent" to each 
other. 

The system uses three methods to identify adjacent pair of 35 
micro-calcifications in the cluster. All the pairs in the cluster 
are examined, and the adjacent ones are selected. The system 
connects all the adjacent micro-calcifications by connecting 
lines to form a desired set of adjacent line segments. The 
system measures three parameters corresponding to said line 40 
segments, which characterize the structure of micro - 
calcification clusters. These parameters are: (1) the length of 
each fine segment; (2) the number of neighbors of each 
micro-calcification region; and (3) the density of the micro- 
calcification cluster. 4S 

The first method for identifying adjacent micro- 
calcification is based on a triangulation technique known as 
the Gabriel method. According to this method, the system 
considers all possible pairs of micro-calcifications in a 
cluster. For each pair, the system connects a line between the 
micro-calcification MC's constituting a pair. A circle whose 
diameter is the same as the connecting line and whose center 
coincides with the middle of the line is drawn. If the circle 
does not contain any micro-calcification, then the two 
micro-calcifications in the cluster are considered adjacent. 

The second method for identifying adjacent micro- 
calcifications is based on another triangulation method 
known as the Sphere of Influence Graph (SIG). This method 
utilizes the value of the distance to the nearest neighboring 
micro-calcification which was defined above as the sixth 
parameter identifying a micro-calcification. The system 
draws a circle around each micro-calcification having a 
radius equal to the distance to the nearest neighboring 
micro-calcification. Two micro-calcifications are considered 
adjacent by the SIG method, if the corresponding circles 
intersect. 

The third method for identifying adjacent micro- 
calcification is based on another triangulation method 



known as the , Digital. rDelaunay^TrianguJation- method.* A™ 
process commonly known as "zone of influence" is applied 
to the cluster to provide a zone of influence for each 
micro-calcification. 

The system labels each micro-calcification in the cluster 
by a number. All pixels in each micro-calcification receive 
the same number. Pixels in the image that do not belong to 
a micro-calcification MC are labelled "Q." Thereafter, each 
pixel in the region of interest is processed according to a 
certain criteria as described hereinafter. 

First, if a pixel has any label except "0," its label remains 
unchanged. 

Second, if a pixel has a label "0" and within its surround- 
ing eight pixels or 3x3 vicinity, there are pixels which have 
non-zero labels "L", the pixel is also labeled "L/* 

Third, if a pixel has a label "0" and within its surrounding 
eight pixels or 3x3 vicinity, there exists two pixels which 
have different non-zero labels, the pixel remains unchanged. 
This means that the pixel is located at the boundary of two 
zones of influence. 

The system applies the above three steps to the image 
repeatedly until no more changes are detected. Two micro- 
calcifications MC are considered adjacent, if there exists a 
pixel, which, within its surrounding eight pixels or 3x3 
vicinity, there are pixels which have the labels of the two 
m icro- calcific at io ns. 

After the system identifies all adjacent micro- 
calcifications based on the above three methods, it generates 
a set of line segments that connect the adjacent pairs. The 
system draws the line segments on a portion of digital image 
for viewing "adjacent" micro-calcifications on the screen 
display. Based on the generated set of line segments, the 
system calculates three parameters as follows: (1) the length 
of line segment; (2) the number of neighbors of each 
micro-calcification; and (3) the density of the cluster. 

For the first parameter — the length of the line segment — 
the system calculates the length of the line segments that 
connect two adjacent micro-calcification regions as identi- 
fied by each of the three methods described above for 
40 identifying adjacent micro-calcifications MC. The system 
then calculates the average and standard deviation of the 
length of all line segments in the region of interest. The 
average value of the line segments is estimated by known 
arithmetic methods. In addition the average value of the line 
45 segments is also estimated based on the mean value of the 
two extreme values in the set. The standard deviation of the 
line segments is estimated by known arithmetic methods. In 
addition the standard deviation of the line segments is also 
estimated based on the difference between the two extreme 
50 values in the set divided by two. Altogether 12 parameters 
based on the length of the line segments are calculated. 

Next the system obtains two parameters associated with 
the number of neighbors of each micro-calcification in the 
cluster. The number of neighbors is defined as the number of 
55 micro-calcifications that are considered adjacent to a given 
micro-calcification under each of the three methods 
described above. The two associated parameters are the 
average number of neighbors calculated by standard arith- 
metic methods and standard deviation calculated by known 
statistical methods. Altogether 6 parameters based on the 
number of neighbors are calculated. 

Finally, the system obtains a value representing the den- 
sity of the cluster, which is the average number of micro- 
calcifications MC's per unit area of a cluster. Because the 
Sphere of Influence Graph (SIG) method described above, is 
closely related to the visual perception of the interconnec- 
tions between micro-calcification regions, the parameters 
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xalculated~by.-the « SIG» method are.* used_aoiXalculate v ihe>i r 
density of a cluster. Thus, the density of a cluster is derived 
by the relationship: 



density » 



where N is the average number of neighbors obtained based 
on SIG method, and L is the average length of line segments 
obtained based on the SIG method. 

Table 2 illustrates a list of the parameters that characterize 
the structure of micro-calcification clusters derived by the 
three methods known as: (1) Gabriel; (2) Sphere of Influence 
Graph and; (3) Delaunay. The letter "E" denotes the alter- 
native calculation methods for finding the average and the 
standard deviation. These parameters assist in the diagnosis 
of micro-calcifications observed on a mammogram. The 
value for each parameter is compared with statistically 
derived values to determine whether the observed micro- 
calcifications are malignant or benign. 

TABLE 2 

These characteristics are calculated for the cluster as a whole, 
by triangulation methods. Three basic methods 
are used: Sig, Delaunay and Gabriel 



Average Distance Between 

Calcifications (Sig) 

Deviation of Distance Between 

CalificaUoris (Sig) 

Average of Distance Between 

Caiifications (E) 

Deviation of Distance Between 

CaJifications (E) 

Average No. of Neighbors (Sig) 

Deviation of No. Neighbors (Sig) 

Average No. of Neighbors (Sig) (E) 

Deviation of No. of Neighbors 
(Sig)(E) 

Average Distance Between 
Caiifications (Delaunay) 
Deviation of Distance Between 
edifications (Delaunay) 
Average Distance Between 
edifications (Delaunay) (E) 
Deviation of Distance Between 
Caiifications (Deluanay) (E) 



Average No. of 
Neighbors (Delaunay) 
Deviation of No. Neighbors 
(Delaunay) 

Average No. of Neighbors 

(Delaunay) (E) 

Deviation of No. Neighbors 

(Delaunay) (E) 

Average Distance Between 

Caiifications (Gabriel) 

Deviation of Distance 

Between Caiifications (Gabriel) 

Average Distance 

Between Caiifications (Gabriel) (E) 

Deviation of Distance 

Between Caiifications (Gabriel) (E) 

Deviation of No. of Neighbors 

(Gabriel) 

Average of No. of Neighbors 
(Gabriel) (E) 

Deviation of No. of Neighbors 
(Gabriel) (E) 

Spatial Density of Caiifications 
Within the Cluster 



VISUALIZATION AND QUANTIFICATION OF 
MASS SPICULAnON 

In addition to micro-calcification, other breast malignan- 
cies have the appearance of a stellate lesion having a distinct 
central tumor mass and a radiating structure with ill defined 



•then : applies a moving-color enhancement process by gradu-, 
ally changing the brightness of the digital image using the 
grey scale stretching process described in connection with 
FIGS. 3A-3D. Each pixel in the digital image acquires a 
5 new grey level and therefore a corresponding color based on 
a conversion curve as illustrated in FIGS. 3A-3D. The color 
enhancement process begins with a conversion curve with 
its center disposed to the right of the grey scale. The system 
gradually moves the center of the conversion curve to the 
10 left of the scale. Consequently, the converted images which 
are displayed on screen display 4 of FIG. 1, first appear in 
darker colors and as the center of the conversion curve 
moves to the left of the scale, they appear in brighter colors. 
The conversion curves have the lowest possible slope to 
15 yield images with minimum contrast. The infiltrative effects 
of the mass can be visualized more clearly because of the 
dynamic and gradual change of colors in the new images 
according to the present invention. This allows for a better 
visual appreciation of mass malignancy. 
20 Id order to quantify the degree of spiculation, in a separate 
process, the system identifies all spiculation pixels of a 
digital image and, if a mass exists, it calculates certain 
parameters that represent the degree of spiculation in a 
tumor mass. 

25 To quantify the degree of spiculation of a mass in the 
image, the center of the spiculation (CS) is defined by the 
operator. In an alternative embodiment, the system auto- 
matically identifies this center. The system proceeds with 
calculations based on the spatial distribution of grey levels 

30 in the mass and its surrounding regions. 

The calculations begin by determining the gradient of 
grey level for each pixel, more conveniently referred to as 
the gradient of each pixel. The gradient of a pixel G(P) is a 
vector whose amplitude is the maximum rate of change of 

35 grey level from that pixel to the surrounding pixels in the 
direction where that maximum rate of change occurs and is 
defined by the relationship 



40 



G(P) 



dp 

dy 



where i and j are unit vectors along the x and y axis and p 
is the grey level of a pixel along the z axis as a function of 
the pixel's location along the x and y axis. 
45 Thereafter, the rate of change of grey levels of all pixels 
in the direction of the center of spiculation CS is measured. 
TTiis is done by calculating the radius vector of each pixel 
relative to the center of spiculation CS. The vector 1(P) is the 
unit vector perpendicular to the radius vector along the line 
50 connecting the pixel to the center of spiculation CS. The rate 
of change of the grey levels at each pixel in relation to the 
center of spiculation can be obtained by the projection of the 
gradient vector G(P) on the direction of 1(P). This is the 
scalar product of the gradient of a pixel and the 1(P). 



borders. The radiating structure consists of spicules which 

are sharp, dense, fine lines of variable length radiating in all 55 Consequently, each pixel is assigned a gradation number 



directions either within or outside the central tumor mass 
The larger the central tumor mass, the longer the spicules. 
The tumor mass may appear on the original digital image of 
the mammogram as an ill denned bright spot with border 
fines spreading out as illustrated in FIG. 8A. The system 
provides two different tools to visualize the mass and to 
quantify the degree of its spiculation. 

In order to visualize the mass, the system provides a 
dynamic view of the digital image in color. First, the grey 



based on the scaler product. 

Because the structure of spiculation is such that the 
highest rate of change in grey levels, in relation to the center 
of spiculation CS, occurs at the borders of the spicules with 
60 its surrounding, the pixels which receive high gradation 
numbers are considered Spiculation Pixels (SP). By identi- 
fying the spiculation pixels the system provides a better 
visualization of the mass. 



The identification of spiculation pixels (SP) is explained 
level values are mapped into an RGB space by using a grey 65 more fully hereinafter with reference to FIGS. 8B-3D. At 
level to RGB look-up table. As a result the look-up table step 800, the system filters the digital image to reduce 
yields a different color for each grey level value. The system background noise by using a 3x3 uniform convolution mask. 
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. .^Jo.the-preferred embodiment the system- at .steps-802:and • .. .system atstep 820 assigns arvalue^-0"4o the*corresponding'< 

804 perfonns the morphology operations "Grey scale Qos- pixel. At step 822 the thresholding operation yields a Binary 

ing" and "Grey scale opening." Grey scale closing is Gradient Image (BGI). At step 824 a filtering operation is 

referred to in the art as the process of successive application performed on the Binary Gradient Image (BGI) whereby all 

of the morphological operations; "dilation" and "erosion." 5 objects having diameters less than 0.14 mm are erased from 

Grey scale opening is the successive application of the ^ ima g e - resulting image is illustrated in FIG. 8B 

morphological operations; "erosion" and "dilation." The whcrc 710 correspond to the spicules of a mass, 

structuring element for these operations is a cylinder mask ^ te locatlon of » u the P kels that belong to the 

of0.22mmKliameterandl4greylevelheight.Themaskcan ?f cuUuoo PaUern only, i.e the Spiculation Pixels (SP) is 

be viewed as a three dimensional matrix, with the value in 10 ^J?** ° n th f Bmary Gradient Image BGI. 

u _ . • n l • .u i i u ■ tv r .u Ine system at step 826 begins to calculate certain param- 

each matrix eel being the g ey level height. The S1 ze of the ^ ^ c J d t0 ^ of the spiculati on of a 

mask is computed by the relationship: mass ^ para 1 meters mdude f (1) Spiculation Ratio (SR); 

(2) Shift of Histogram of Spiculation Pixels SP(HSP); (3) 

^pixels) _ Q-22 mm xfliT S i opc of normalized Histogram HSPnorm; and (4) Height of 

25 4 15 normalized Histogram HSPnorm. 

At step 826, the system calculates the Spiculation Ratio 

where X is the size of the mask in pixels, and DPI is the which is defined as: 
resolution of the scanning process in dots per inch. The 0.22 

mm represents the average size of the width of spicules in $R m ^sp 

mammography images. 20 N1M 

At step 806 the system develops the Gradient Image (GI) 

of the original digital image by transforming the grey level where NSP is the amount of Spiculation Pixels in Binary 

value of each pixel into a new grey level value following the Gradient Image, for which the value of cos [1(P) * G(P)] 

relationship exceeds a given threshold number, which according to the 

25 preferred embodiment, is 0.75, and N1M is the total number 
of pixels in the image. 

67(/>|C?| [Cos (1(P) 1 G(P)f At step 828, the system calculates the histogram of Cos [ 

1(P) * G(P) ] after dividing the values of the Cos [ 1(P) * 

where GI(P) is the new grey level value of each pixel in the G(p) ] mt0 a givcn Dum5er of ^mls. In mc pre f errcd 

Gradient Image GI, |G| is the modulus of the gradient of each 30 embodiment the given number of intervals is 200. This 

pixel in the original digital image and [1(P) A G(P)] is the histogram is referred to as the histogram of Spiculation 

radian measure of the angle between the radius vector and Pixels or sp FIG 8C illustrates the histogram of 

the gradient of each pixel in the original digital image. Spiculation Pixels 

Because all the cosine values are between 0 and 1 and get M slep g3 0> the calcu i ales ^ shift of lhe hist0 . 

smaller as the angle reaches 90°, the power 8 lowers the 35 gram ^ Mft ^ as tbe cosine value that 

effect of pixels that form a large angle between the radius me histogram SP (HSP) into two parts with equal areas as 

vector and their gradients. For example: illustrated by line 714 in FIG. 8C. 

For Cos(80>0.98 and Cos (45°)=0.71 the ratio of Cos M step ^ the system calculates mc s i opc 0 f thc 

(SO)/ Cos (45 ) is approximately 1.4. histogram. The slope is computed by first obtaining the 

Whereas: 40 max imum value of the histogram. The entire histogram is 

For Cos (80 ) -0.88 and Cos (45 ) ~0.06 the ratio of Cos men divided by mis max imum value to obtain a normalized 

(80°) / Cos (45°) is approximately 15. histogram HSPnorm. The values of the part of HSPnorm 

Because the value range of GI(P) is very narrow, the from zero up t0 the value of Shift are approximated by a 

system is required to stretch the new Gradient Image, while straighl une 716, defined as Ax+B. The slope of the straight 

taking into consideration certain parameters of the image. 4S Hne is defined ^ the slope of me histogram and is t0 

The mean value of GI(P) over the entire image G\ mean and ^ 

the standard deviation Gl std are calculated at step 808. The FinallVj at ^ 834 me system calculates me he ight of the 

system at step 810 calculates G^ and GI^ which are the histogram. The height is defined as the value B in the 

minimum and maximum grey level values in the gradient equatio n of the straight Une Ax+B defined above. Altogether 

image GI and are defined as: 50 four pmmctcrs m calculated for the evaluation of the 

Mammographic Spiculation. These parameters assist in the 
diagnosis of tumor masses observed on a mammogram. The 
value of each parameter is compared, either manually or 

Gim~ a Gim*-.+yji**i automatically by the system , with statistically derived values 

55 to determine whether the observed masses are malignant or 

The system at step 812 stretches the interval [GI mih , benign based on the degree of spiculation. 

GI^] linearly from 0 to 255. It will be evident to those skilled in the art that the 

In the preferred embodiment the system at step 814 invention is not limited to the details of the foregoing 

applies another "Grey scale Closing" in order to join very illustrative embodiments and that the present invention may 

close bright regions along a spicule. The structuring element 60 be embodied in other specific forms without departing from 

for this operation is a cylindrical mask of 0.14 mm diameter the spirit or essential attributes thereof. The present embodi- 

and 14 grey level height as explained above. ments are therefore to be considered in all respects as 

The system at step 816 performs a thresholding operation illustrative and not restrictive, the scope of the invention 

by determining whether the grey level of a pixel in the being indicated by the appended claims rather than by the 

Gradient Image exceeds a given threshold. In the preferred 65 foregoing description, and all changes which come within 

embodiment, this threshold is 40. If so the system at step 818 the meaning and range of equivalency of the claims are 

assigns a value "1" to the corresponding pixel. If not, the therefore intended to be embraced therein. 
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^-v-AVhatis claimed ?is: . - r-t*r-<»-.v> ^>l-^j *w.v. > v-*vv> 

1. A system for diagnosis of living tissue diseases, com- 
prising: 

a computer device for controlling the operation of said 
system; 

an operator control device coupled to said computer 
device; 

a viewing screen coupled to said computer device fbr 
displaying digitized images of said living tissue, said 
operator control device selecting desired portions of 
said digitized image for further image enhancement 
according to a desired image enhancement feature 
selectable from a plurality of image enhancement fea- 
tures; 

said plurality of image enhancement features including 
any combination of grey scale stretching using an 
S-shaped grey scale conversion curve, contrast 
enhancement based on logarithmic histogram 
equalization, and spot enhancement. 

2. The system according to claim 1 further comprising 
means for visualization and quantification of micro- 
calcifications. 

3. The system according to claim 2 further comprising 
means for visualization and quantification of mass spicula- 
tions. 

4. The system as claimed in claim 1, further comprising 
means for displaying the grey level values of at least one 
pixel on the digital image. 



10 



15 



20 



their/> surroundings, ~ diminishing^lhe differences above -:a «• **. .t < 
certain threshold of grey levels and accentuating the differ- 
ences below a certain threshold. 

14. A system for diagnosis of living tissue diseases, 
comprising: 

a microcomputer for controlling the operation of said 
system; 

a memory coupled to said microcomputer for storing 

information as directed by said microcomputer; 
a scanning device coupled to said microcomputer for 

scanning a mammogram to provide a digital image of 

said mammogram for storing, viewing and further 

processing; 

a viewing screen coupled to said microcomputer wherein 
said digital image of said mammogram is displayed on 
said viewing screen; 

said microcomputer including circuit means enabling 
on-line display of selected portions of said scanned 
mammogram; and 

means for generating a plurality of grey scale conversion 
curves having a desired center and a desired slope at 
said center, said conversion curves converting the grey 
scale of said digital image into a new grey scale of a 
converted digital image, said desired center being a 
grey level value corresponding to said digital image 
such that for all said plurality of grey scale conversion 
curves said value of desired center is converted into a 
fixed grey level value on the new converted scale. 

15. The system according to claim 14 wherein said grey 
scale conversion curve includes an exponential curve from 



5. The system as claimed in claim 1, further comprising . . . urvJ A • - j . . , ... 

a network terminal for transmitting information to otbel 30 S re y l cvc ' value Cf to said desired center and a logarithmic 

& curve frnm sairi HesireH renter tn orp-.v Iftvp.l valnp. W 7SS ** 

locations. 



6. A method for diagnosis of living tissue diseases, 
comprising the steps of: 

providing a digital image of said living tissue to a com- 35 
puter; 

displaying said digital image on a viewing screen; 
selecting a portion of said digital image displayed on said 

viewing screen; 
enhancing the image contained within the selected portion 40 
according to one or more options from a plurality of 
image enhancement features including grey scale 
stretching using an S-shaped grey scale conversion 
curve, contrast enhancement based on logarithmic his- 
togram equalization, and spot enhancement, 
i 7. The method according to claim 6 further comprising the 
steps of visualizing micro-calcifications and quantifying 
said micro-calcifications. 

8. The method according to claim 7 further comprising the 
steps of visualizing mass spiculations and quantifying said 
mass spiculations. 

9. The method as claimed in claim 8, wherein said 
enhancement of the displayed image is accomplished in real 
time. 

10. The method as claimed in claim 6, wherein said grey 55 
scale stretching further comprises the step of converting 
original grey levels of the image into new values according 
to a curve including exponential and logarithmic portions. 

11 . The method as claimed in claim 10, wherein said 
conversion curve yields images with adjustable contrast and 60 
brightness. 

12. The method as claimed in claim 6, wherein said digital 
image is enhanced by utilizing a logarithmic histogram 
equalization. 

13. The method as claimed in claim 6, wherein said spot 65 
enhancement step further comprises the steps of checking 
the grey level difference between pixels of the image and 



curve from said desired center to grey level value "255." 

16. The system according to claim 15 wherein said fixed 
grey level value on the new converted scale is "127." 

17. The system according to claim 16 further comprising 
means for generating a look up table representing said grey 
scale conversion curve. 

18. The system according to claim 17 further comprising: 
means for selecting a desired grey scale conversion curve 

for yielding a new digital image which is either darker 
and brighter than the original digital image; and 
means for selecting a desired slope at said center for 
yielding a digital image with a variable contrast 

19. The system according to claim 18 further comprising 
means for generating a color look up table for converting 

45 said new digital image into a color image with pixels having 
different colors according to different combinations of RGB 
components. 

20. The system according to claim 19 further comprising: 
means for generating a plurality of conversion curves with 

center values ranging from a low grey level value to a 
high grey level value; and 
means for displaying converted digital images based on 
said plurality of conversion curves, such that a chang- 
ing color image appears on said viewing screen. 

21. The system according to claim 20 further comprising: 
means for determining an initial grey scale conversion 

curve including, 

means for generating a histogram of said digital image, 
means for selecting two grey level values gl and g2 
such that a given K percent of pixels in said digital 
image have original grey level values below gl and 
a given N percent of pixels in said digital image have 
original grey level values above g2, 
means for selecting said center and said slope such that 
a given (100-(K+N)) percent of new grey level 
values scale to original grey level values between gl 
and g2. 
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22-.*/Aasystemizfor^diagnosis*o£v-Jiving tissue.-diseases,. 
comprising: 

a microcomputer for controlling the operation of said 
system; 

a memory coupled to said microcomputer for storing 
information as directed by said microcomputer; 

a scanning device coupled to said microcomputer for 
scanning a mammogram to provide a digital image of 
said mammogram for storing, viewing and further 
processing; 

a viewing screen coupled to said microcomputer wherein 
said digital image of said mammogram is displayed on 
said viewing screen; 

said microcomputer including circuit means enabling 
on-line display of selected portions of said scanned 
mammogram; and 

means for generating a plurality of grey scale conversion 
curves for converting the grey scale of said digital 
image into a new grey scale said grey scale conversion 
curves including an exponential curve from grey level 
value "0** to a desired grey level and a logarithmic 
curve from said desired grey level to grey level value 
"255." 

23. The system according to claim 22 wherein the slope 
of said exponential curve and said logarithmic curves are 
equal at said desired grey level. 

24. The system according to claim 23 wherein said slope 
is variable. 

25. The system according to claim 24 further comprising 
means for generating a look up table representing said grey 
scale conversion curve. 

26. A system for diagnosis of living tissue diseases 
comprising: 

a microcomputer for controlling the operation of said 
system; 

a scanning device couple to said microcomputer for 
scanning a mammogram and providing a digital image 
of said scanned mammogram; 

means for generating a cumulative logarithmic histogram 
of said digital image; and 

means for generating a look-up table for converting said 
digital image with a grey Level scale into a new digital 
image with a new grey level scale such that the cumu- 
lative logarithmic histogram of said new digital image 
is equal to said generated cumulative logarithmic his- 
togram. 

27. The system according to claim 26 wherein said means 
for generating a cumulative logarithmic histogram of said 
digital image provides a plurality of cumulative logarithmic 
histogram curves CH(X), following the relationship 



CH(x) = [C//(255) - Cff(0)] ' 



Ln (x + 1) 
Ln(256) 



h CH(0) 
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where "x" is a grey level value of said digital image between 
0 and 255, "q" is a constant parameter for each of said 
cumulative logarithmic histogram curves, CH(255) is total 
amount of pixels in the digital image with a grey level value 
equal to maximum grey level in said digital image and 
CH(0) is the total amount of pixels in the digital image with 
a grey level value equal to minimum grey level in said 
digital image. 

28. The system according to claim 27 further comprising 
means for generating the cumulative histogram of said 
digital image, wherein said lookup table is an exponential 
function 



30 



where LUT(x) is the lookup table transformation function 
and p is defined as 



ch(x) - ch(0) 



*Ln(256) 



where ch(x) is cumulative histogram of the digital image 
before transformation and ch(255) is the total number of 
pixels in the region of interest and ch(0) is the number of 
pixels with a grey level value equal to minimum grey level 
value in said digital image. 

29. The system according to claim 28 further comprising 
means for varying said factor "q" for generating a plurality 
of said lookup tables. 

30. The system according to claim 29 further comprising 
a pointing device coupled to said microcomputer wherein 
sliding movement of said pointing device back and forth 
along one direction causes the change in said constant "q". 

31. The system according to claim 30 wherein said 
movement of said pointing device along an x axis changes 
a grey level value mx from 0 to 255 and said constant q is 
calculated by relationship 



-('-TO") 



La 



Ln (nix + 1) 

U(25fi> 



32. A system for diagnosis of living tissue diseases 
comprising: 

a microcomputer for controlling the operation of said 
system; 

a scanning device coupled to said microcomputer for 
scanning a mammogram and providing a digital image 
of said scanned mammogram; 

means for comparing grey level values between pixels of 
the image and their surroundings; and 

means for generating a new digital image wherein differ- 
ences above a certain threshold of grey levels are 
diminished and differences below a certain threshold of 
grey levels are accentuated. 

33. The system according to claim 32 wherein said means 
for comparing the grey level values between pixels of the 
image and their surroundings further comprises: 

means for generating a contrast table having a plurality of 
pairs of grey level values the first element of each pair 
being grey level value of each pixel in the digital image 
and the second element of each pair being the average 
value of grey levels of a desired number of pixels 
surrounding said pixel in the digital image; 

means for comparing said plurality of pairs of grey level 
values; and 

means for reducing said plurality of pairs when elements 
in one pair overlap with elements in another pair until 
none of the remaining pairs overlap. 

34. The system according to claim 33 wherein said means 
for generating a new digital image further comprises: 

means for generating a lookup table having a plurality of 
incrementing steps, the input of which is the grey level 
values of said digital image, each step representing an 
interval defined by each pair among said remaining 
pairs, said lookup table converting the grey level values 
within each interval into new grey level values which 
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■i * are ^ linearly distributed within a. fixed, incremenfcalong < - - r.-. ^means-for measuring the degree.of spiculation. of a-mass n. 

the new grey scale. including, 
35. A system for diagnosis of living tissue diseases, means for generating a binary gradient image of said 

comprising: digital image said binary gradient image having 

a microcomputer for controlling the operation of said 5 identified spiculation pixels, and 

system; means for measuring spiculation ratio based on said 

a memory coupled to said microcomputer for storing binary gradient image. 

information as directed by said microcomputer; 42 - ^ system according to claim 41 further comprising 

a scanning device coupled to said microcomputer for me ^ T g eDeratin S ^togram of spioilation pixels. 

scanning a mammogram to provide a digital image of 10 43 * ™ e s *f em acco ' dl n \ * claim 42 further comprising 

said mammogram for storing, viewing and further means for f^**** shlft of said histogram of spicu- 

oroce in lation pixels. 

. . , 44- The system according to claim 43 further comprising 

a viewing screen coupled to said microcomputer wherein means fof me sl of said histogram of ^i^. 

said digital image of said mammogram is displayed on 15 j a ^ on pj xc is 

said viewing screen; 45 The systcm according to claim 44 comprising 

said microcomputer mcluding circuit means enabling means for calculating the height of said histogram of spicu- 
on-line display of selected portions of said scanned lation pixels. 

mammogram; 46. In a computer based system, a method for diagnosis of 

means for user definition of micro-calcifications by inter- 20 living tissue diseases, comprising the steps of: 

actively trimming a grey level threshold such that all scanning a mammogram to provide a digital image of said 
pixels above said grey level threshold are highlighted mammogram for storing, viewing and further process- 



as micro-calcifications; and 



ing; 



a region growing means for estimating the contour of said displaying said digital image of said mammogram on a 

micro-calcifications, said region growing means com- 2s viewing screen; 

prising means for selecting and defining a current set of selecting a desired portion of said digital image; and 

calcium pixels for each said micro^alrification. generating a plurality of grey scale conversion curves 

36. The system according to claim 35 further comprising: having a dcsircd centcr and a dcsired sbpc at ^ 

a background suppression means for suppressing the center, each one of said conversion curves converting 

background image; and 30 ^ gKy gcale of ^ digital image int0 a new grey 

means for producing an image with micro-calcifications scale of a converted digital image, said desired center 

having estimated contours which closely approximate being a grey level value corresponding to said digital 

the actual contour of said micro-calcifications. image such that for all said plurality of grey scale 

37. The system according to claim 36 further comprising conversion curves said value of desired center is con- 
means for estimating a plurality of parameters of each 35 verted into a fixed grey level value on the new con- 
micro -calcification corresponding to brightness, area, verted scale. 

length, shape factor and distance to the nearest micro- 47. The method according to claim 46 wherein said grey 

calcification. scale conversion curve includes an exponential curve from 

38. The system according to claim 37 further comprising grey level value "0" to said desired center and a logarithmic 
means for identifying all pairs of micro-calcifications within 40 curve from said desired center to grey level value "255". 

a cluster that are considered to be adjacent using a triangu- 48. The method according to claim 47 further comprising 

lation technique. the steps of: 

39. The system according to claim 38 further comprising selecting a desired grey scale conversion curve for yield- 
means for generating a plurality of line segments connecting mg a new digital image which is either darker and 
said pairs of adjacent micro-calcifications. 45 brighter than the original digital image; and 

40. The system according to claim 39 further comprising selecting a desired slope at said center for yielding a 
means for calculating a plurality of parameters based on said ^ a variable contrast. 

line segments including the length of each line segment, the 49 ^ melhod accord i n g to claim 48 further comprising 

number of neighbors of each micro-calcification and the me step 0 f generating a color look up table for converting 

density of a micro-calcification cluster. said new digital image ^ a ^Iot image with pixels having 

41. A system for diagnosis of living tissue diseases, different colors according to different combinations of RGB 
comprising: components. 

a microcomputer for controlling the operation of said 50. The method according to claim 49 further comprising 

system; 55 the steps of generating a plurality of images resulting from 

a memory coupled to said microcomputer for storing a plurality of conversion curves with center values ranging 

information as directed by said microcomputer; from a low grey level value to a high grey level value; 

a scanning device coupled to said microcomputer for displaying said plurality of images at a given rate creating 

scanning a mammogram to provide a digital image of an appearance of a moving image with changing colors, 

said mammogram for storing, viewing and further 60 51. tn a computer based system, a method for diagnosis of 

processing; living tissue diseases comprising the steps of: 

a viewing screen coupled to said microcomputer wherein scanning a mammogram and providing a digital image of 

said digital image of said mammogram is displayed on said scanned mammogram to said computer; 

said viewing screen; generating a cumulative logarithmic histogram of said 

said microcomputer including circuit means enabling 65 digital image; and 

on-line display of selected portions of said scanned generating a look-up table for converting said digital 

mammogram; and image with a grey level scale into a new digital image 
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. t « ^r^wjth.a * ne Wtgrey, level scale - sucthithauthe , cumulative - 
logarithmic histogram of said new digital image closely 
approximates said generated cumulative logarithmic 
histogram. 

52. The method according to claim 51 wherein said step 
of generating a cumulative logarithmic histogram of said 
digital image provides a plurality of cumulative logarithmic 
histogram curves CH(X), following the relationship 



CH(x) - [Ctf(255) - Cff(0)] ' 



Ln (x + 1) 
Ln(256) 



10 



h 0/(0) 



where "x" is a grey level value of said digital image between 
0 and 255, "q" is a constant parameter for each of said 
cumulative logarithmic histogram curves, CH(255) is total 
amount of pixels in the digital image with a grey level value 
equal to maximum grey level in said digital image and 
CH(0) is the total amount of pixels in the digital image with 
a grey level value equal to minimum grey level in said 
digital image. 

53. The method according to claim 52 further comprising 
the step of generating the cumulative histogram of said 
digital image, wherein said lookup table is an exponential 
function 

LUT(x)=f-l 

where LUT(x) is the lookup table transformation function 
and p is defined as 



20 
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ch(x)- 



' Lo(256) 
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where ch(x) is cumulative histogram of the digital image 
before transformation and ch(255) is the total number of 
pixels in the region of interest and cfa(Cf) is the number of 
pixels with a grey level value equal to minimum grey level 
value in said digital image. 

54. The method according to claim 53 further comprising 
the step of varying said factor "q" for generating a plurality 
of said lookup tables. 

55. In a computer based system, a method for diagnosis of 
living tissue diseases comprising the steps of: 

scanning a mammogram and providing a digital image of 45 

said scanned mammogram; 
comparing grey level values between pixels of the image 

and their surroundings; and 
generating a new digital image wherein differences above 

a certain threshold of grey levels are diminished and 

differences below a certain threshold are accentuated. 

56. The method according to claim 55 wherein said step 
for comparing the grey level values between pixels of the 
image and their surroundings further comprises: 

generating a contrast table having a plurality of pairs of 
grey level values the first element of each pair being 
grey level value of each pixel in the digital image and 
the second element of each pair being the average value 
of grey levels of a desired number of pixels surround- 
ing said pixel in the digital image; 

comparing said plurality of pairs of grey level values; 

reducing said plurality of pairs when elements in one pair 
overlap with elements in another pair until none of the 
remaining pairs overlap; 

generating a lookup table having a plurality of increment- 
ing steps, the input of which is the grey level values of 
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- - .^ • said.i digital* image, each step.* representing- an -inte rvalue 
defined by each pair among said remaining pairs, said 
lookup table converting the grey level values within 
each interval into new grey level values which are 
linearly distributed within a fixed increment along the 
new grey scale. 

57. In a computer based system a method for diagnosis of 
living tissue diseases, comprising the steps of: 

scanning a mammogram to provide a digital image of said 
mammogram for storing, viewing and further process- 
ing; 

displaying said digital image on a viewing screen; 

selecting a desired portion of said scanned mammogram; 

displaying micro-calcifications which are user-defined by 
interactively trimming a grey level threshold such that 
all pixels above said grey level threshold are high- 
lighted as micro-calcifications; 

estimating the contour of said micro-calcifications using a 
region growing process, said region growing process 
comprising selecting and defining a current set of 
calcium pixels for each said micro-calcification; and 

producing an image with micro-calcifications which 
closely approximates the actual contour of said micro- 
calcifications. 

58. The method according to claim 57 further comprising 
the steps of: 

suppressing the background image prior to said step of 
interactive trimming; 

estimating a plurality of parameters of each micro- 
calcification region corresponding to brightness, area, 
length, shape factor and distance to the nearest micro- 
calcification region after said step of producing an 
image with micro-calcifications. 

59. A method according to claim 58 further comprising 
the steps of: 

identifying all pairs of micro-calcifications within a clus- 
ter that are considered to be adjacent using a triangu- 
lation technique; 

generating a plurality of line segments connecting said 
pairs of adjacent micro-calcifications; and 

calculating a plurality of parameters based on said line 
segments including the length of each line segment, the 
number of neighbors of each micro -calcification and 
the density of a micro-calcification cluster. 

60. In a computer based system, a method for diagnosis of 
living tissue diseases, comprising the steps of: 

scanning a mammogram to provide a digital image of said 
mammogram for storing, viewing and further process- 
ing; 

displaying said digital image on a viewing screen; 
selecting a desired portion of said digital image; and 
measuring the degree of spiculation of a mass by, gener- 
ating a binary gradient image of said digital image said 
binary gradient image having identified spiculation 
pixels. 

61. The method according to claim 60 further comprising 
the steps of: 

measuring spiculation ratio based on said binary gradient 
image; 

generating histogram of spiculation pixels; 
calculating the shift, the slope and the height of said 
histogram of spiculation pixels. 
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